Bayesian Index Models for Heterogeneous Treatment Effects on a Binary Outcome.

This paper develops a Bayesian model with a flexible link function connecting a binary treatment response to a linear combination of covariates and a treatment indicator and the interaction between the two. Generalized linear models allowing data-driven link functions are often called "single-index models" and are among popular semi-parametric modeling methods. In this paper, we focus on modeling heterogeneous treatment effects, with the goal of developing a treatment benefit index (TBI) incorporating prior information from historical data. The model makes inference on a composite moderator of treatment effects, summarizing the effect of the predictors within a single variable through a linear projection of the predictors. This treatment benefit index can be useful for stratifying patients according to their predicted treatment benefit levels and can be especially useful for precision health applications. The proposed method is applied to a COVID-19 treatment study.

Developing a Bayesian hierarchical model for a prospective individual patient data meta-analysis with continuous monitoring.

BACKGROUND: Numerous clinical trials have been initiated to find effective treatments for COVID-19. These trials have often been initiated in regions where the pandemic has already peaked. Consequently, achieving full enrollment in a single trial might require additional COVID-19 surges in the same location over several years. This has inspired us to pool individual patient data (IPD) from ongoing, paused, prematurely-terminated, or completed randomized controlled trials (RCTs) in real-time, to find an effective treatment as quickly as possible in light of the pandemic crisis. However, pooling across trials introduces enormous uncertainties in study design (e.g., the number of RCTs and sample sizes might be unknown in advance). We sought to develop a versatile treatment efficacy assessment model that accounts for these uncertainties while allowing for continuous monitoring throughout the study using Bayesian monitoring techniques. METHODS: We provide a detailed look at the challenges and solutions for model development, describing the process that used extensive simulations to enable us to finalize the analysis plan. This includes establishing prior distribution assumptions, assessing and improving model convergence under different study composition scenarios, and assessing whether we can extend the model to accommodate multi-site RCTs and evaluate heterogeneous treatment effects. In addition, we recognized that we would need to assess our model for goodness-of-fit, so we explored an approach that used posterior predictive checking. Lastly, given the urgency of the research in the context of evolving pandemic, we were committed to frequent monitoring of the data to assess efficacy, and we set Bayesian monitoring rules calibrated for type 1 error rate and power. RESULTS: The primary outcome is an 11-point ordinal scale. We present the operating characteristics of the proposed cumulative proportional odds model for estimating treatment effectiveness. The model can estimate the treatment's effect under enormous uncertainties in study design. We investigate to what degree the proportional odds assumption has to be violated to render the model inaccurate. We demonstrate the flexibility of a Bayesian monitoring approach by performing frequent interim analyses without increasing the probability of erroneous conclusions. CONCLUSION: This paper describes a translatable framework using simulation to support the design of prospective IPD meta-analyses.

Development and Validation of a Treatment Benefit Index to Identify Hospitalized Patients With COVID-19 Who May Benefit From Convalescent Plasma.

Importance: Identifying which patients with COVID-19 are likely to benefit from COVID-19 convalescent plasma (CCP) treatment may have a large public health impact. Objective: To develop an index for predicting the expected relative treatment benefit from CCP compared with treatment without CCP for patients hospitalized for COVID-19 using patients' baseline characteristics. Design, Setting, and Participants: This prognostic study used data from the COMPILE study, ie, a meta-analysis of pooled individual patient data from 8 randomized clinical trials (RCTs) evaluating CCP vs control in adults hospitalized for COVID-19 who were not receiving mechanical ventilation at randomization. A combination of baseline characteristics, termed the treatment benefit index (TBI), was developed based on 2287 patients in COMPILE using a proportional odds model, with baseline characteristics selected via cross-validation. The TBI was externally validated on 4 external data sets: the Expanded Access Program (1896 participants), a study conducted under Emergency Use Authorization (210 participants), and 2 RCTs (with 80 and 309 participants). Exposure: Receipt of CCP. Main Outcomes and Measures: World Health Organization (WHO) 11-point ordinal COVID-19 clinical status scale and 2 derivatives of it (ie, WHO score of 7-10, indicating mechanical ventilation to death, and WHO score of 10, indicating death) at day 14 and day 28 after randomization. Day 14 WHO 11-point ordinal scale was used as the primary outcome to develop the TBI. Results: A total of 2287 patients were included in the derivation cohort, with a mean (SD) age of 60.3 (15.2) years and 815 (35.6%) women. The TBI provided a continuous gradation of benefit, and, for clinical utility, it was operationalized into groups of expected large clinical benefit (B1; 629 participants in the derivation cohort [27.5%]), moderate benefit (B2; 953 [41.7%]), and potential harm or no benefit (B3; 705 [30.8%]). Patients with preexisting conditions (diabetes, cardiovascular and pulmonary diseases), with blood type A or AB, and at an early COVID-19 stage (low baseline WHO scores) were expected to benefit most, while those without preexisting conditions and at more advanced stages of COVID-19 could potentially be harmed. In the derivation cohort, odds ratios for worse outcome, where smaller odds ratios indicate larger benefit from CCP, were 0.69 (95% credible interval [CrI], 0.48-1.06) for B1, 0.82 (95% CrI, 0.61-1.11) for B2, and 1.58 (95% CrI, 1.14-2.17) for B3. Testing on 4 external datasets supported the validation of the derived TBIs. Conclusions and Relevance: The findings of this study suggest that the CCP TBI is a simple tool that can quantify the relative benefit from CCP treatment for an individual patient hospitalized with COVID-19 that can be used to guide treatment recommendations. The TBI precision medicine approach could be especially helpful in a pandemic.

Association of Convalescent Plasma Treatment With Clinical Status in Patients Hospitalized With COVID-19: A Meta-analysis.

Importance: COVID-19 convalescent plasma (CCP) is a potentially beneficial treatment for COVID-19 that requires rigorous testing. Objective: To compile individual patient data from randomized clinical trials of CCP and to monitor the data until completion or until accumulated evidence enables reliable conclusions regarding the clinical outcomes associated with CCP. Data Sources: From May to August 2020, a systematic search was performed for trials of CCP in the literature, clinical trial registry sites, and medRxiv. Domain experts at local, national, and international organizations were consulted regularly. Study Selection: Eligible trials enrolled hospitalized patients with confirmed COVID-19, not receiving mechanical ventilation, and randomized them to CCP or control. The administered CCP was required to have measurable antibodies assessed locally. Data Extraction and Synthesis: A minimal data set was submitted regularly via a secure portal, analyzed using a prespecified bayesian statistical plan, and reviewed frequently by a collective data and safety monitoring board. Main Outcomes and Measures: Prespecified coprimary end points-the World Health Organization (WHO) 11-point ordinal scale analyzed using a proportional odds model and a binary indicator of WHO score of 7 or higher capturing the most severe outcomes including mechanical ventilation through death and analyzed using a logistic model-were assessed clinically at 14 days after randomization. Results: Eight international trials collectively enrolled 2369 participants (1138 randomized to control and 1231 randomized to CCP). A total of 2341 participants (median [IQR] age, 60 [50-72] years; 845 women [35.7%]) had primary outcome data as of April 2021. The median (IQR) of the ordinal WHO scale was 3 (3-6); the cumulative OR was 0.94 (95% credible interval [CrI], 0.74-1.19; posterior probability of OR <1 of 71%). A total of 352 patients (15%) had WHO score greater than or equal to 7; the OR was 0.94 (95% CrI, 0.69-1.30; posterior probability of OR <1 of 65%). Adjusted for baseline covariates, the ORs for mortality were 0.88 at day 14 (95% CrI, 0.61-1.26; posterior probability of OR <1 of 77%) and 0.85 at day 28 (95% CrI, 0.62-1.18; posterior probability of OR <1 of 84%). Heterogeneity of treatment effect sizes was observed across an array of baseline characteristics. Conclusions and Relevance: This meta-analysis found no association of CCP with better clinical outcomes for the typical patient. These findings suggest that real-time individual patient data pooling and meta-analysis during a pandemic are feasible, offering a model for future research and providing a rich data resource.

Efficacy and Safety of COVID-19 Convalescent Plasma in Hospitalized Patients: A Randomized Clinical Trial.

Importance: There is clinical equipoise for COVID-19 convalescent plasma (CCP) use in patients hospitalized with COVID-19. Objective: To determine the safety and efficacy of CCP compared with placebo in hospitalized patients with COVID-19 receiving noninvasive supplemental oxygen. Design, Setting, and Participants: CONTAIN COVID-19, a randomized, double-blind, placebo-controlled trial of CCP in hospitalized adults with COVID-19, was conducted at 21 US hospitals from April 17, 2020, to March 15, 2021. The trial enrolled 941 participants who were hospitalized for 3 or less days or presented 7 or less days after symptom onset and required noninvasive oxygen supplementation. Interventions: A unit of approximately 250 mL of CCP or equivalent volume of placebo (normal saline). Main Outcomes and Measures: The primary outcome was participant scores on the 11-point World Health Organization (WHO) Ordinal Scale for Clinical Improvement on day 14 after randomization; the secondary outcome was WHO scores determined on day 28. Subgroups were analyzed with respect to age, baseline WHO score, concomitant medications, symptom duration, CCP SARS-CoV-2 titer, baseline SARS-CoV-2 serostatus, and enrollment quarter. Outcomes were analyzed using a bayesian proportional cumulative odds model. Efficacy of CCP was defined as a cumulative adjusted odds ratio (cOR) less than 1 and a clinically meaningful effect as cOR less than 0.8. Results: Of 941 participants randomized (473 to placebo and 468 to CCP), 556 were men (59.1%); median age was 63 years (IQR, 52-73); 373 (39.6%) were Hispanic and 132 (14.0%) were non-Hispanic Black. The cOR for the primary outcome adjusted for site, baseline risk, WHO score, age, sex, and symptom duration was 0.94 (95% credible interval [CrI], 0.75-1.18) with posterior probability (P[cOR<1] = 72%); the cOR for the secondary adjusted outcome was 0.92 (95% CrI, 0.74-1.16; P[cOR<1] = 76%). Exploratory subgroup analyses suggested heterogeneity of treatment effect: at day 28, cORs were 0.72 (95% CrI, 0.46-1.13; P[cOR<1] = 93%) for participants enrolled in April-June 2020 and 0.65 (95% CrI, 0.41 to 1.02; P[cOR<1] = 97%) for those not receiving remdesivir and not receiving corticosteroids at randomization. Median CCP SARS-CoV-2 neutralizing titer used in April to June 2020 was 1:175 (IQR, 76-379). Any adverse events (excluding transfusion reactions) were reported for 39 (8.2%) placebo recipients and 44 (9.4%) CCP recipients (P = .57). Transfusion reactions occurred in 2 (0.4) placebo recipients and 8 (1.7) CCP recipients (P = .06). Conclusions and Relevance: In this trial, CCP did not meet the prespecified primary and secondary outcomes for CCP efficacy. However, high-titer CCP may have benefited participants early in the pandemic when remdesivir and corticosteroids were not in use. Trial Registration: ClinicalTrials.gov Identifier: NCT04364737.

Prospective individual patient data meta-analysis: Evaluating convalescent plasma for COVID-19.

As the world faced the devastation of the COVID-19 pandemic in late 2019 and early 2020, numerous clinical trials were initiated in many locations in an effort to establish the efficacy (or lack thereof) of potential treatments. As the pandemic has been shifting locations rapidly, individual studies have been at risk of failing to meet recruitment targets because of declining numbers of eligible patients with COVID-19 encountered at participating sites. It has become clear that it might take several more COVID-19 surges at the same location to achieve full enrollment and to find answers about what treatments are effective for this disease. This paper proposes an innovative approach for pooling patient-level data from multiple ongoing randomized clinical trials (RCTs) that have not been configured as a network of sites. We present the statistical analysis plan of a prospective individual patient data (IPD) meta-analysis (MA) from ongoing RCTs of convalescent plasma (CP). We employ an adaptive Bayesian approach for continuously monitoring the accumulating pooled data via posterior probabilities for safety, efficacy, and harm. Although we focus on RCTs for CP and address specific challenges related to CP treatment for COVID-19, the proposed framework is generally applicable to pooling data from RCTs for other therapies and disease settings in order to find answers in weeks or months, rather than years.